A Self-Supervised Deep Learning Framework for Unsupervised Few-Shot Learning and Clustering
نویسندگان
چکیده
The need to learn a good representation is core problem central AI. We present self-supervised learning framework and demonstrate its use for few-shot classification clustering. Our can be interpreted as repeatedly discovering new categories from learned embeddings training embedding function with signals differentiate the discovered categories. In our framework, we first discover unlabeled data. Next post-process previous partition results remove outliers derive prototypes of each category. then construct tasks previously selected data augmented virtual Lastly, iterative train network through steps final representation. considerably outperform baselines in unsupervised on miniImageNet Omniglot sets. also validate clustering that further improves upon recent deep methods.
منابع مشابه
Meta-Learning for Semi-Supervised Few-Shot Classification
In few-shot classification, we are interested in learning algorithms that train a classifier from only a handful of labeled examples. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for a learning algorithm is defined and trained on episodes representing different classification problems, each with a small labeled training set and its corres...
متن کاملSemi-Supervised Few-Shot Learning with Prototypical Networks
We consider the problem of semi-supervised few-shot classification (when the few labeled samples are accompanied with unlabeled data) and show how to adapt the Prototypical Networks [10] to this problem. We first show that using larger and better regularized prototypical networks can improve the classification accuracy. We then show further improvements by making use of unlabeled data.
متن کاملFew-shot Learning
Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...
متن کاملIterative Double Clustering for Unsupervised and Semi-Supervised Learning
We present a powerful meta-clustering technique called Iterative Double Clustering (IDC). The IDC method is a natural extension of the recent Double Clustering (DC) method of Slonim and Tishby that exhibited impressive performance on text categorization tasks [12]. Using synthetically generated data we empirically find that whenever the DC procedure is successful in recovering some of the struc...
متن کاملSemi-supervised Zero-Shot Learning by a Clustering-based Approach
In some of object recognition problems, labeled data may not be available for all categories. Zero-shot learning utilizes auxiliary information (also called signatures) describing each category in order to find a classifier that can recognize samples from categories with no labeled instance. In this paper, we propose a novel semi-supervised zero-shot learning method that works on an embedding s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 2021
ISSN: ['1872-7344', '0167-8655']
DOI: https://doi.org/10.1016/j.patrec.2021.05.004